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Question 6 


Intent of Question 





The primary goals of this investigative task were to assess students’ ability to (1) evaluate whether a 
double-blind randomized experiment is possible, (2) construct and interpret a confidence interval for the 
difference between two proportions, (3) estimate a relative risk and construct and interpret a confidence 
interval for a relative risk, and (4) compare the confidence interval for the difference between two 
proportions and the confidence interval for the relative risk. 


Solution 
Part (a): 


Yes, it can. An experiment is said to be double-blind when the control or comparison group and the 
treatment group are treated exactly alike, except for the treatments of interest, so that neither the 
patients nor the researchers who care for the patients and take measurements know which treatment 
has been assigned to any patient. Because treatment A must be administered by pill and treatment B 
must be administered by injection, then a placebo could be introduced for each treatment group as 
follows to make the study double-blind: 


The patients who get treatment A also get a placebo injection. The patients who get treatment B also 
get a placebo pill. The physician does not have to know which treatment the patient is receiving if the 
treatment plus placebo is sent to him or her by a researcher not in contact with the patients (this 
researcher is the only one who knows which treatment each patient is receiving). 


Part (b): 


Step 1: Identify the appropriate confidence interval by name or formula and check appropriate 
conditions. (The question states that the conditions for inference have been met.) 


Two-sample z confidence interval for the difference of two proportions. 
OR 
[he formula for the confidence interval given in step 2 is provided. 


nq 





Step 2: Correct mechanics. 


38 
154 


16 


= 0.2468 = 0.25 and pp, = 164 


Let Pa = = 0.0976 = 0.10. Then, the 95 percent confidence 


interval is 














5 - : : 38 38 16 16 
(ba — Ba) t2" Pa (1 Pa) , Pa (l= bs) -(2 16 } £1.96 ier(1 - 3) S iar (1 — 354) 
Be i fis 154 164) 154 164 
= 0.1492 + 1.96 x 0.0418 
= 0.1492 + 0.0818 


(0.0674, 0.2310) 
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Question 6 (continued) 


Step 3: Interpretation. 


At the 95 percent confidence level, the range of plausible values for the true difference in the 15- 
year survival rates for the two treatments is 0.0674 to 0.2310. Because this interval is entirely above 
zero, this suggests that the 15-year survival rate is higher for treatment A. 


Part (c): 


The estimate of the relative risk is 





id 38 
Pie 184 ~ 2.5292 = 2.53 
Pp 764 


Part (d): 


A 95 percent confidence interval for the relative risk is found by evaluating 


903888 £5 ©1489) Which is 1.47 to 4.34. 


At the 95 percent confidence level, the range of plausible values for the relative risk is 1.47 to 4.34. 
People are between 1.47 and 4.34 times more likely to survive 15 or more years with treatment A than 


with treatment B. 


Part (e): 


When the proportions of people who survive are low, as is the case with 0.25 and 0.10, it may be more 
meaningful or vivid to know that a patient’s chance of survival with treatment A is 1.47 to 4.34 times 
what it would be with treatment B rather than to know that the difference in the proportions of people 
who survive is 0.07 to 0.23, which does not sound like very much. 

Scoring 


This problem is scored in four sections. Section 1 consists of part (a). Section 2 consists of part (b). Section 
3 consists of part (c) and part (d). Section 4 consists of part (e). Sections 1, 2, 3, and 4 are each scored as 
essentially correct (E), partially correct (P), or incorrect (I). 


Section 1 [part (a)] is scored as follows: 


Essentially correct (E) if the student (1) communicates what is meant by a double-blind study and 
(2) clearly describes how this experiment can be performed as a double-blind experiment. 


Partially correct (P) if only one component is correct. 


Incorrect (I) otherwise. 
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Question 6 (continued) 
Section 2 [part (b)] is scored as follows: 


Essentially correct (E) if the correct confidence interval is identified and constructed AND interpreted 
in context. 


Partially correct (P) if the correct confidence interval is identified and constructed, but the 
interpretation is not in context or no interpretation is given. 

OR 
There are calculation errors with the appropriate confidence interval, but the interpretation follows 
correctly from the interval and is in context. 





Incorrect (I) if the confidence interval and interpretation are not reasonable. 
Section 3 [part (c) and part (d)] is scored as follows: 
Essentially correct (E) if the student correctly (1) sets up and calculates the estimated relative risk, 
(2) sets up and calculates the confidence interval for the relative risk, and (3) interprets the confidence 
interval in context. 
Partially correct (P) if the student provides only two correct components. 
Incorrect (I) otherwise. 


Section 4 [part (e)] is scored as follows: 


Essentially correct (EF) if the student (1) provides an advantage of using the confidence interval for the 
relative risk and (2) addresses both intervals. 


Partially correct (P) if the first component is correct. 
Incorrect (I) otherwise. 


Each essentially correct (E) response counts as 1 point, and each partially correct (P) response counts as 
¥% point. 


4 Complete Response 

3 Substantial Response 
2 Developing Response 
1 Minimal Response 


If a response is between two scores (for example, 22 points), use a holistic approach to determine whether 
to score up or down, depending on the strength of the response and communication. 
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STATISTICS 
SECTION II 
Part B 
Question 6 — 
Spend about 25 minutes on this part of the exam. 
Percent of Section II score—25 


Directions: Show all your work. Indicate clearly the methods you use, because you will be graded on the 
correctness of your methods as well as on the accuracy and completeness of your results and explanations. 


6. Two treatments, A and B, showed promise for treating a potentially fatal disease. A randomized experiment was 
conducted to determine whether there is a significant difference in the survival rate between patients who receive 
treatment A and those who receive treatment B. Of 154 patients who received treatment A, 38 survived for at 
least 15 years, whereas 16 of the 164 patients who received treatment B survived at least 15 years. 


1g 
| Yisy Nee 
(a) Treatment A can be administered only as a pill, and treatment B can be administered only as an injection. 
Can this randomized experiment be performed as a double-blind experiment? Why or why not? 
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applied , They will not ened whether Hay gave/rece/ved 
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been met. Consfryet and inGppret 


e condition: herce 
aifrerence between the proportion of the population who would survive at leas 
and the proportion of the population who would survive at least 15 years if given treatment B. 


2 eOP- Z-Infervat .| 








CT= Cay-Pp) 


“ ' 





Lisy 


= 0144 F (1,460)(o,040) 
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We ore 45% Sue thet the actrat ditlyente. tv 
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In many of these types of studies, physicians are interested in the ratio of survival probabilities, oe , where 
B 


Pa tepresents the true 15-year survival rate for all patients who receive treatment A and pg represents the true 


15-year survival rate for all patients who receive treatment B. This ratio is usually referred to as the relative risk 
of the two treatments. 


For example, a relative risk of 1 indicates the survival rates for patients receiving the two treatments are equal, 
whereas a relative risk of 1.5 indicates that the survival rate for patients receiving treatment A is 50 percent 


higher than the survival rate for patients receiving treatment B. An estimator of the relative risk is the ratio of 
estimated probabiliti¢s, a 
ee EP Bp 


Ly ieee 
ai 


(c) Using the data from the raridomized experiment described above, comput 


emt te Soy re) 
Clavive ret = ST = > 
Pew Ba Ayo | 





GO ON TO THE NEXT PAGE. 
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The sampling distribution of Pa ; is skewed. However, when both sample sizes n, and ng are relatively large, 
Bs 


PA. eT Aci Pa ,i— PB 
& \PB a Wika: + TBP 


and’ pp. 


the distribution of in( Sa A Pa _ the natural = of relative risk — is approximately normal with a mean of 
B 


Pa and pz, can be estimated by using p, 





When a 95 percent confidence interval for n( 20) is known, an approximate 95 percent confidence interval for 
PB 


P a — the relative risk of the two treatments — can be constructed by applying the inverse of the natural 
LLL LOL 


Leta in ntS of the confidence interval for. in( 24). 


paces in the experiment above, and a 95 percent confidence 
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a By See a 
28 


min= In (fA) = O. 3969 


Pa , an 
‘7 CC O.3969 alee 


MAX = in( fa) = pape 


Ps 


S Pa. A. 


_ 
eer 7 ee ee 


Je ah. a azn ave that the. actued polaris 


cieket shee Lcatmeats i 7S) between 


GO ON TO THE NEXT PAGE. 
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(e) What is an advantage of using the interval in part (d) over using the interval in part (b) ? 
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STOP 


END OF EXAM 


THE FOLLOWING INSTRUCTIONS APPLY TO THE COVERS OF THE 
SECTION ll BOOKLET. 


e MAKE SURE YOU HAVE COMPLETED THE IDENTIFICATION 
INFORMATION AS REQUESTED ON THE FRONT AND BACK 
COVERS OF THE SECTION Il BOOKLET. 


© CHECK TO SEE THAT YOUR AP NUMBER LABEL APPEARS IN 
THE BOX(ES) ON THE COVER(S). 


@ MAKE SURE YOU HAVE USED THE SAME SET OF AP 


NUMBER LABELS ON ALL AP EXAMS YOU HAVE TAKEN 
THIS YEAR. 
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STATISTICS 
SECTION I 
Part B 
Question 6 
Spend about 25 minutes on this part of the exam. 
Percent of Section II score—-25 


Directions: Show all your work. Indicate clearly the methods you use, because you will be graded on the 
correctness of your methods as well as on the accuracy and completeness of your results and explanations. 


6. Two treatments, A and B, showed promise for treating a potentially fatal disease. A randomized experiment was 
conducted to determine whether there is a significant difference in th i i who receive 
treatment A and those who receive treatment B. Of 154 patients who received treatment A, 38 survived for at 
least 15 years, whereas 16 of the 164 patients who received treatment B survived at least 15 years. 


(a) Treatment A can be administered only asa pill, and treatment B can be administered only as an injection. 
Can this randomized experiment be performed as a double-blind experiment? Why or why not? 


No, It will be obeus duat oll wea dtrs tated 


‘ 


suet | a obi fferent” treatments secause vt 
dle di ffeunet between methods aused 40 trpose 

tents, | , 
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sumived ends be, blind 


*¢ : kk ved, 
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(b) The conditions for inference have been met. Construct and interpret a 95 percent confidence interval for the 
difference between the proportion of the population who would survive at least 15 years if given treatment A 
and the proportion of the population who would survive at least 15 years if given treatment B. 
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In many of these types of studies, physicians are interested in the ratio of survival probabilities, oa , where 
B 


Pa Tepresents the true 15-year survival rate for all patients who receive treatment A and pg represents the true 


15-year survival rate for all patients who receive treatment B. This ratio is usually referred to as the relative risk 
of the two treatments. <= 


For example, a relative risk of 1 indicates the survival rates for patients receiving the two treatments are equal, 
whereas a relative risk of 1.5 indicates that the survival rate for patients receiving treatment A is 50 percent 
higher than the survival rate for patients receiving treatment B. An estimator of the relative risk is the ratio of 





B 


(c) Using the data from the randomized experiment described above, compute the estimate of the relative risk.: 





pA Pa [az aT 2468 


| (Patti) + (Bo 1-Ps) \ = £ SA8% + 0042 


GO ON TO THE NEXT PAGE. 
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sn 


The sampling distribution of as is skewed. However, when both sample sizes n4 and ng are relatively large, 








Pg 
the distribution of inf os } —— the natural logarithm of relative risk — is approximately normal with a mean of 
B 
Hor 1- 1- : bk ta 
In (2a.) and a standard deviation of EA ge ER , where p, and pp, can be estimated by using p, 
PB "APA = "'BPB 
and pz- 


When a 95 percent confidence interval for In (24) is known, an approximate 95 percent confidence interval for 
" 
a — the relative risk of the two treatments — can be constructed by applying the inverse of the natural 
B ‘ 


logarithm to the endpoints of the confidence interval for In (24), 
B 


(d) The conditions for inference are met for the data in the experiment above, and a 95 percent confidence 


interval for In (24) is (0.3868, 1.4690). Construct and interpret a 95 percent confidence interval for the 
B 


relative risk, = , of the two treatments. 
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GO ON TO THE NEXT PAGE. 
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(e) What is an advantage of using the interval in part (d) over using the interval in part (b) ? 
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STOP 


END OF EXAM 


THE FOLLOWING INSTRUCTIONS APPLY TO THE COVERS OF THE 
SECTION Il BOOKLET. 


e MAKE SURE YOU HAVE COMPLETED THE IDENTIFICATION 
INFORMATION AS REQUESTED ON THE FRONT AND BACK 
COVERS OF THE SECTION Ii BOOKLET. 


e CHECK TO SEE THAT YOUR AP NUMBER LABEL APPEARS IN 
THE BOX(ES) ON THE COVER(S). 


e MAKE SURE YOU HAVE USED THE SAME SET OF AP 
NUMBER LABELS ON ALL AP EXAMS YOU HAVE TAKEN 
THIS YEAR. 
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STATISTICS 
SECTION I 
Part B 
Question 6 
Spend about 25 minutes on this part of the exam. 
Percent of Section II score—25 


Directions: Show all your work. Indicate clearly the methods you use, because you will be graded on the 
correctness of your methods as well as on the accuracy and completeness of your results and explanations. 


6. Two treatments, A and B, showed promise for treating a potentially fatal disease. A randomized experiment was 
conducted to determine whether there is a significant difference in the survival rate between patients who receive 
treatment A and those who receive treatment B. Of 154 patients who received treatment A, 38 survived for at 
least 15 years, whereas 16 of the 164 patients who received treatment B survived at least 15 years. 


(a) Treatment A can be administered only as a pill, and treatment B can be administered only as an injection. 
Can this randomized experiment be performed as a double-blind experiment? Why or why not? 
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dreatmets, re peope aduniwttents He erases worA 
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(b) The conditions for inference have been met. Construct and interpret a 95 percent confidence interval for the 
difference between the proportion of the population who would survive at least 15 years if given treatment A 
and the proportion of the population who would survive at least 15 years if given treatment B. 
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In many of these types of studies, physicians are interested in the ratio of survival probabilities, a , where 
B 


Pa Tepresents the true 15-year survival rate for all patients who receive treatment A and pp represents the true 


15-year survival rate for all patients who receive treatment B. This ratio is usually referred to as the relative risk 
of the two treatments. 


For example, a relative risk of 1 indicates the survival rates for patients receiving the two treatments are equal, 
whereas a relative risk of 1.5 indicates that the survival rate for patients receiving treatment A is 50 percent 
higher than the survival rate for patients receiving treatment B. An estimator of the relative risk is the ratio of 


estimated probabilities, a 
B 


(c) Using the data from the randomized experiment described above, compute the estimate of the relative risk. 
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GO ON TO THE NEXT PAGE. 
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The sampling distribution of Ls is skewed. However, when both sample sizes n, and ng are relatively large, 
PB 
the distribution of In (Za) — the natural logarithm of relative risk — is approximately normal with a mean of 
a : 








_ ip, 1 = . on 
In (24) and a standard deviation of EA 0 PH , where p, and pp can be estimated by using p, 
PB "APA = "'BPB 


and pp. 


When a 95 percent confidence interval for in( 24} is known, an approximate 95 percent confidence interval for 
B 
= — the relative risk of the two treatments —- can be constructed by applying the inverse of the natural 
B 


logarithm to the endpoints of the confidence interval for In (24) . 
B 


(d) The conditions for inference are met for the data in the experiment above, and a 95 percent confidence 


interval for In (Za is (0.3868, 1.4690). Construct and interpret a 95 percent confidence interval for the 
B 


relative risk, Pa , of the two treatments. 
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(e) What is an advantage of using the interval in part (d) over using the interval in part (b) ? 
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END OF EXAM 


THE FOLLOWING INSTRUCTIONS APPLY TO THE COVERS OF THE 
SECTION Ii BOOKLET. 


e MAKE SURE YOU HAVE COMPLETED THE IDENTIFICATION 
INFORMATION AS REQUESTED ON THE FRONT AND BACK 
COVERS OF THE SECTION Ii BOOKLET. 


e CHECK TO SEE THAT YOUR AP NUMBER LABEL APPEARS IN 
THE BOX(ES) ON THE COVER(S). 


e MAKE SURE YOU HAVE USED THE SAME SET OF AP 
NUMBER LABELS ON ALL AP EXAMS YOU HAVE TAKEN 
THIS YEAR. 
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Question 6 


Sample: 6A 
Score: 4 


In part (a) this response reflects understanding that a double-blind study requires that neither the patients 
nor the researchers will be able to detect which treatment is being administered and then suggests 
providing a placebo injection to those patients who receive treatment A and a placebo pill to those 
patients who receive treatment B. Thus section 1 [part (a)] was scored as essentially correct. In part (b) the 
confidence interval for the difference of two proportions is identified both by name ("2 prop. z-interval”) 
and formula. The mixed notation, “ p,” and “ p,” along with “ p, ” and “ p, ,” was considered a minor error. 


The interval is computed and interpreted correctly, although the student uses the phrase “95% sure” in 
place of the preferred words, 95 percent confident. Section 2 [part (b)] was therefore scored as essentially 
correct. Part (c) provides the correct value for the estimated relative risk, with work shown, and part (d) 
provides a correct confidence interval with interpretation. Thus section 3 was scored as essentially correct. 
Part (e) conveys the correct idea that when the proportions are small, reporting a confidence interval for 
how many times greater one proportion is than the other may better help people understand how the 
proportions differ than reporting a confidence interval for their difference, which can look insignificant. A 
nice example is included. Section 4 [part (e)] was scored as essentially correct. Because sections 1, 2, 3, 
and 4 were each scored essentially correct, this complete response received a score of 4. 





Sample: 6B 
Score: 3 


Part (a) of this response does not include a method for making the study double-blind, but it does 
communicate that in a double-blind experiment the patients and the researchers must not know which 
treatments are assigned to which patients and that such would not be the case for the patient if one 
treatment were given by injection and the other by a pill. Thus section 1 was scored as partially correct. In 
part (b) it was not necessary to state or check the conditions for constructing a confidence interval for the 
difference of two proportions. The formula for the interval, with correct computations and a correct 
interpretation, are provided, so section 2 was scored as essentially correct. Part (c) provides an incorrect 
confidence interval for the relative risk when only a point estimate is required. The confidence interval in 
part (d) is correct, as is the interpretation. So section 3 was scored partially correct. In part (e) the student 
notes that stating how many times more effective one treatment is than another seems more “vivid” in 
contrast with the interval computed in part (b), where the difference in the proportions appears small. 
Section 4 was therefore scored as essentially correct. Because sections 2 and 4 were essentially correct, 
and sections 1 and 3 were partially correct, this substantial response received a score of 3. 


Sample: 6C 
Score: 2 


Part (a) of this response does not include a method for making the study double-blind, but it does 
communicate that in a double-blind experiment the patients and the medical practitioners must not know 
which treatment is being administered and that such would not be the case, at least for the practitioners, 
if one treatment is given by injection and the other by a pill. Thus, section 1 was scored as partially 
correct. In part (b) the confidence interval is correct and the interpretation is excellent, but neither the 
name of the test nor the formula is included. Thus section 2 was scored as partially correct. The relative 
risk in part (c) and the confidence interval in part (d) are computed correctly. However, the interpretation 
of the confidence interval in part (d) is incorrect. The student refers to “the true values of the relative risk” 
when in fact there is only one true value of this risk. Furthermore, when using this confidence interval, one 


© 2009 The College Board. All rights reserved. 
Visit the College Board on the Web: www.collegeboard.com. 


AP® STATISTICS 
2009 SCORING COMMENTARY (Form B) 


Question 6 (continued) 


would be interested in whether it contained 1 (rather than 0). Thus section 3 was scored as partially 
correct. The first sentence of part (e) makes a correct statement about relative risk, but this is not an 
advantage of using a confidence interval for relative risk rather than a confidence interval for the difference 
of the two proportions. The first part of the second sentence is true as well, but the sampling distribution 
for the difference of two proportions also is approximately normal, so normality is not an advantage for the 
interval of part (d). Section 4 was therefore scored as incorrect. Because sections 1, 2, and 3 were each 
partially correct and section 4 was incorrect, this developing response received a score of 2. 
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